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Abstract. For a general class of dynamical systems (of which the canonical continuous and 
uniform discrete versions are but special cases), we prove that there is a state feedback gain such 
that the resulting closed-loop system is uniformly exponentially stable with a prescribed rate. The 
methods here generalize and extend Gramian-based linear state feedback control to much more 
general time domains, e.g. nonuniform discrete or a combination of continuous and discrete time. 
In conclusion, we discuss an experimental implementation of this theory. 
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1. Introduction 

Linear systems theory is well-studied in both the continuous and discrete settings [SJ EH ES2 , but 
recently an important line of investigation has been generalizing the known linear systems theory 
on K and Z to nonuniform discrete domains or domains with a mixture of discrete and continu- 
ous parts. Progress toward this has been made on the topics of controllability/observability and 
reachability/realizability [THIHE], Laplace transforms [TSJ [T7J [TH] , Fourier transforms [3T], Lyapunov 
equations [TH[T!5], and various types of stability results including Lyapunov, exponential, and BIBO 
[HHHEE]. The goal is not to simply reprove existing, well-known theories, but rather to view K and 
i— —i Z as special cases of a single, overarching theory and to extend the theory to dynamical and control 

systems on these more general domains. Doing so reveals a rich mathematical structure which has 
great potential for new applications in diverse areas such as adaptive control |20j , real-time com- 
munications networks [HJ [52] , dynamic programming [37] , switched systems [32J , stochastic models 
0i population models [39], and economics [3j[4]. The focus of this paper is the study of linear state 
feedback controllers [29j [38] in this generalized setting and to compare and contrast these results 
with the standard continuous and uniform discrete scenarios. 

d 

IT* 2. Time Scales Background 

G\ 

2.1. What Are Time Scales? The theory of time scales springs from the 1988 doctoral dissertation 
of Stefan Hilger [25] that resulted in his seminal paper [24] . These works aimed to unify various 
overarching concepts from the (sometimes disparate) theories of discrete and continuous dynamical 
systems [33], but also to extend these theories to more general classes of dynamical systems. From 
there, time scales theory advanced fairly quickly, culminating in the excellent introductory text by 
Bohncr and Peterson [H] and the more advanced monograph j7J. A succinct survey on time scales 
can be found in pQ. 

A time scale T is any nonempty, (topologically) closed subset of the real numbers R. Thus time 
scales can be (but are not limited to) any of the usual integer subsets (e.g. Z or N), the entire real 
line K, or any combination of discrete points unioned with closed intervals. For example, if q > 1 is 
fixed, the quantum time scale g z is defined as 

?:={/:fceZ}U{0}. 
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Table 1. Canonical time scales compared to the general case. 
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The quantum time scale appears throughout the mathematical physics literature, where the dynam- 
ical systems of interest are the g-difference equations [9l HU [13| . Another interesting example is the 
pulse time scale Va^ formed by a union of closed intervals each of length a and gap b: 

P a ,b :={J[k(a + b),k(a + b)+a]. 

k 

This time scale is used to study duty cycles of various waveforms. Other examples of interesting 
time scales include any collection of discrete points sampled from a probability distribution, any 
sequence of partial sums from a series with positive terms, or even the infamous Cantor set. 

The bulk of engineering systems theory to date rests on two time scales, M and Z (or more 
generally /iZ, meaning discrete points separated by distance h). However, there are occasions when 
necessity or convenience dictates the use of an alternate time scale. The question of how to approach 
the study of dynamical systems on time scales then becomes relevant, and in fact the majority of 
research on time scales so far has focused on expanding and generalizing the vast suite of tools 
available to the differential and difference equation theorist. We now briefly outline the portions of 
the time scales theory that are needed for this paper to be as self-contained as is practically possible. 

2.2. The Time Scales Calculus. We now review the time scales calculus needed for the remainder 
of the paper. 

The forward jump operator is given by o~(t) :— inf sS T{s > t}, while the backward jump operator 
is p(t) := sup s6T {s < t}. The graininess function n(t) is given by /Lt(t) := a(t) — t. 

A point t G T is right-scattered if a(t) > t and right dense if a(t) = t. A point t € T is 
left-scattered if p(t) < t and left dense if p(t) = t. If t is both left-scattered and right-scattered, we 
say t is isolated or discrete. If t is both left-dense and right-dense, we say t is dense. The set T K is 
defined as follows: if T has a left-scattered maximum m, then T K = T — {m}; otherwise, T K = T. 

For / : T — > K and t € T K , define f A (t) as the number (when it exists), with the property that, 
for any e > 0, there exists a neighborhood U of t such that 

\[f(a(t))-f(s)]-f A (t)[a(t)-s]\ <e\a(t)-s\, VseU. (2.1) 
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Table 2. Differential operators on time scales. 
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time scale 


differential operator 


notes 


T 


„A(+\ _ x(a(t))-x(t) 


generalized derivative 


K 




standard derivative 


Z 


x A (t) = Ax(t) := x(t + 1) - x(t) 


forward difference 


hZ 


x A (t) = A h x(t) := »(*+'0-»W 


ft-forward difference 


(f 


^(i) = A 9 *(i) :=^fi 


g-difference 


Pa,b 


A/ \ J cr (^) = ^- 


pulse derivative 



Table 3. Integral operators on time scales. 



time scale 


integral operator 


notes 


T 


/ T /(*)A* 


generalized integral 


K 


i h afmt=j b a f(t)dt 


standard Lebesgue integral 


Z 


j b a ttt)At = i: b t=af(t) 


summation operator 




j b a f(t)At = j: b t - h a f(t)h 


/i-summation 




I b a f(t)At = j: b t L q aI ^y t 


g-summation 



The function / : T K • — > K is called the delta derivative or the Hilger derivative of / on T K . 



Equivalently, (2.1 1 can be restated to define the A-differential operator as 

A _ x(a(t)) - x(t) 
() -~ /i(t) 

where the quotient is taken in the sense that fj,(t) — > + when = 0. 

A benefit of this general approach is that the realms of differential equations and difference 
equations can now be viewed as but special, particular cases of more general dynamic equations on 
time scales, i.e. equations involving the delta derivative(s) of some unknown function. See Table [2] 

Since the graininess function induces a measure on T, if we consider the Lebesgue integral over 
T with respect to the /i-induced measure, 

f f(t)Mt), 

Jt 

then all of the standard results from measure theory are available [23 j . In particular, under mild 
technical assumptions on the integrand, we obtain the set of integral operators in Table [3] 

The upshot here is that the derivative and integral concepts (and all of the concepts in Table [TJ 
apply just as readily to any closed subset of the real line as they do on R or Z. Our goal is to 
leverage this general framework against wide classes of dynamical and control systems. Progress in 
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:im (z) y 
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Re(A) 





Im(A) 




Ro(A) 


Right: The 


cylinder 



(2.2 1 and inverse cylinder (2.3 1 transformations map the familiar stability region in 



the continuous case to the Hilger circle in the general time scale case. 



this direction has been made in transforms theory [16j|3T], control |T5l (2QJ [2T] , dynamic programming 
[3"T] , and biological models [57] . 

2.3. The Hilger Complex Plane. For [i > 0, define the Hilger complex numbers, the Hilger real 
axis, the Hilger alternating axis, and the Hilger imaginary axis by 



A„ := z £ I : z < >, 



z g K : z > — 



1 




z+ - 


4} 







respectively. For fi = 0, let C := C, R Q := M, A := 0, and I := £R. See Figure [l] 

For a, b g C M , if we define the binary operation a ® := a + 6 + /xa6, then (C M , ffi) forms an 
abelian group. 

Let fi > and z g C M . The Hilger real part of z is defined by 

H.,W == 

and the Hilger imaginary part of z is defined by 



Im^O) := 



Arg(z/i + 1) 
A* 



where Arg(z) denotes the principal argument of z (i.e., — tt < Arg(z) < n). See Figure [T] 
For fi > 0, define the strip 

z e C : -- < Im(z) < - 

and for /i = 0, set Zo := C. Then the cylinder transformation £ M : C M — * Z M is given by 

^(z) := -Log(l + z/i), (2.2) 
A* 

where Log is the principal logarithm function. When /x = 0, set £o(z) = z, for all z G C. Then the 
inverse cylinder transformation £~ : Z M — » C M is 

e ^ _ i 



/i 



(2.3) 



See Figure [T] 

The region Re^z < is naturally important for stability questions involving the linear time 
invariant system x A (t) = Ax(t). We call this region the Hilger circle and denote it by 

H := H„ = {z g C M : Re^(z) < 0} - {z g C p : |1 + H < 1}. 
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Note that as /i — * + , Ti — > C _ , the standard region of exponential stability for the linear time 
invariant system x — Ax. On the other hand, as /i — > 1, 7Y. becomes the standard region of 
convergence for the discrete linear time invariant system Ax — Ax (shifted one unit to the left due 
to the difference equation form rather than recursive form of the system). See the bottom row of 
Table [T] as well as Figure [l] 

Since the graininess may not be constant for a given time scale, we might interchangeably 
subscript various quantities (such as H or £) with /i(t) instead of \i to emphasize this. 

2.4. Generalized Exponential Functions. Before we can use the cylinder transformation to 
define the generalized exponential function on a time scale, we need to define appropriate classes of 
function spaces on which to work. 

A function p : T — > R is rd- continuous on T if p is continuous at right-dense points of T and 
has finite left-hand limits at left-dense points of T. We denote this space of functions by C r d(T, R). 
A matrix is rd-continuous provided each of its entries is rd-continuous. 

A function p : T — > R is regressive if 1 + fi(t)p(t) ^ for all i £ P, and this motivates the 
definition of the following sets: 

1Z:={pE C rd (T, R) : 1 + fi{t)p{t) ^ V* G T K }, 
1Z+ := {p £ K : 1 + fi(t)p(t) > V* € TT}. 

A matrix is regressive provided all of its eigenvalues are regressive. 

1Z under the operation © also forms an abelian group, and the additive inverse of © is denoted 
by ©. For peK, Qp € 1Z where 

em : i + m(*)pW 

If p € 1Z, we define the generalized time scale exponential function e p (t, s) as the unique solution 
to the dynamic initial value problem 

x A (t) = P (t)x(t), x(s) = l, Met. 



It can be shown [8] that a closed form for e p (t, s) is given by 

e p{t ,,) . ex„ (/'f„(p(r))A T ) . ex „ ^' Wl±^Ml» Ar 

where ^ M is the cylinder transformation. 

The following theorem is a compilation of properties of e p (t, to) needed later. 

Theorem 2.1. For p € 1Z, the function e p (t,to) has the following properties: 

(i) e p (t, r)e p (r, s) = e p (t, s) for all r, s, t S T. 

(ii) e p (t, s) = jjjjj = e ep (s,t) 

(iii) e p (t, s)e q (t, s) = e p(Sq (t, s) 

(iv) IfqeK, then = e peq (t, s). 

(v) IfT — R, f/ien e p (t, s) = exp f J* p(r)dr^ . If p is constant, then e p (t, s) = e plyt ~ s \ 

(vi) 7/T = Z, t/ien e p (t, s) = rir= s ( 1 +P(' r ))- Moreover, if J = hZ, with h>0 and p is constant, 
then e p (t, s) = (1 + hp) ~s~ . 

3. Linear State Feedback 

Let A e R nxn , B e R nxm , and C € R pxn be rd-continuous on T with p,m < n, and consider 
the open-loop state equation 

x A (t) = A(t)x(t) + B(t)u(t), x(t ) = x , 
y(t) = C(t)x(t). 
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In the presence of a linear state feedback controller, we replace the input u(t) above with u(t) := 
K(t)x(t) + N(t)r(t), where r(t) represents a new input signal, and K(t) G R mxn , N(t) G R mxm are 
rd-continuous. The corresponding closed-loop system is 

x A (t) = [A(t) + B(t)K(t)} x(t) + B(t)N(t)r(t), x(t ) = x , 
y(t) = C(t)x(t). 

Without loss of generality, we proceed with r(t) = 0. 

Definition 3.1. [15] Let A(t) G R nxn ,B(t) G R nxm ,C(t) G W xn , and D(t) G W xm all be rd- 
continuous functions on T, with p,m < n. The regressive linear system 

x A (t) = A(t)x(t) + B(t)u(t), x(t ) = x , 
y(t) = C(t)x(t) + D(t)u(t), 

is controllable on [to,tf] if given any initial state xq there exists a rd-continuous input signal u(t) 
such that the corresponding solution of the system satisfies x(tf) = Xf. 

Our first result establishes that a necessary and sufficient condition for controllability of the 
linear system (3.1 ) is the invertibility of an associated Gramian matrix. 

Theorem 3.1. |15j The regressive linear system 

x A (t) = A(t)x(t) + B(t)u(t), x(t ) = Xq, 

y(t) = C(t)x(t) + D(t)u(t), 

is controllable on [t ,tf] if and only if the nx n controllability Gramian matrix given by 

#c(to,t f ):= / <S> A (to,<j(t))B(t)B T (t)<S>l(t ,o-(t))At, 



is invertible, where $>z(t,to) is the transition matrix for the system X A (t) = Z(t)X(t), X(to) = I. 

Note that as ^ — > + , this time scale version of the controllability Gramian matches the standard 
controllability Gramian on R, and as fi — > 1 it matches the standard controllability Gramian on Z 
(modulo the unit shift). 

Lemma 3.1. The Hilger circle TL is closed under the operation © for all t G T. 

Proof. Let a £ C be such that \a\ < 1. Then for a given graininess /i, the number a — € TL. 
Similarly, let (3 G C be such that |/3| < 1, so that b — G H. We set 

c := a © b = a + b + jiab. 

Now, c G TL if there exists a 7 G C such that I7I < 1 with c = We claim that the choice 7 = a(3 
will suffice, from which the conclusion follows immediately. 
Indeed, with this choice of 7, 

7-1 a - 1 /3 - 1 a - 1 $ - 1 

= 1 + p , 

[i [i fi fi fi 

and since I7I = \a\ ■ \(3\ < 1, the claim follows. □ 

Unlike on R or Z, in the general time scales setting, there are various ways one could legitimately 
define exponential stability. Potzsche, Siegmund, and Wirth [3S] first did so by bounding the state 
vector above by a decaying regular exponential function. DaCunha [14 generalized their definition 
by allowing the state vector to be bounded above by a time scale exponential function of the form 
e-\(t,to). Even more recently, various authors j30j [34] have used a time scale exponential of the 
form e e \(t,t ). 

In this paper, we adopt DaCunha's definition, but these other definitions could also be used by 
modifying our arguments slightly. 
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Definition 3.2. [14] The regressive linear state equation 

x A {t) = A(t)x(t) + B(t)u(t), x(t ) = x Q , 
y(t) = C(t)x(t), 

is uniformly exponentially stable with rate A > 0, where —A € 7?. + , if there exists a constant 7 > 
such that for any to € T and xq the corresponding solution satisfies 

\\x(t)\\<je- x (t,t )\\x \\, t>t . 

Lemma 3.2 (Stability Under State Variable Change). The regressive linear state equation 

X A (t) = A(t)x(t) + B(t)u(t), X(t ) = Xq, 

y(t) = C(t)x(t), 

is uniformly exponentially stable with rate 1+ ^ +a a , where A, a > such that —A e 1Z + , if the linear 
state equation 

z A {t) = [A(t)(l + fia) + al]z(t), 
is uniformly exponentially stable with rate A. 

Proof. By direct calculation, x{t) satisfies 

x A {t) = A(t)x{t), x(t ) = x , 
if and only if z(t) — e a (t,to)x(t) satisfies 

z A (t) = [A(t)(l + na) + al]z(t), z(t ) = x Q . (3.2) 



Now assume there exists a 7 > such that for any xq and ta the solution of (3.2) satisfies 

IK*)|| <7e-x{t,t )\\x l t>t . 

Then, substituting for z{t) yields 

||e Q (MoM*)|| = e a (Mo)|K*)|| < ie-x{t,t Q )\\x Q \\, 

so that 

IK*)|| < je^x ea (t,t Q ) < 7e-(A+Q)/(i+ AlmaxQ )(t,^o)- 
An application of Lemma |3.1| then gives the result. □ 

Theorem 3.2 ([28j Thm. 1.23]; cf. [14, Thm. 3.2]). Suppose A(t) e K(T,R nxn ). The regressive 
time varying linear dynamic system 

x A (t) = A(t)x(t), x(t ) = x , 

is uniformly exponentially stable if there exists a symmetric matrix Q(t) G C^j(T, R" xn ) such that 
for all t € T 

(i) vi < Q(t) < Pi, 

(ii) [(/ + n(t)A T (t))Q(a(t))(I + Kt)A(t)) - Q(t)} ///(i) < -vl, 
where v, r/, p > and — - G 1Z + . 

In order to achieve the desired stabilization result, we need to define a weighted version of the 
controllability Gramian. For a > define the a-weighted controllability Gramian matrix (to^ */) 
by 

Sfc„(to,*/) := / ' (e a (t 0l s)) 4 ^ A (t ,a( S ))B(s)B T ( S )^l(t Q ,a(s))As. 

Jto 

We are now in position to prove the main result of the paper. 
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Theorem 3.3 (Gramian Exponential Stability Criterion). Consider the regressive linear state 
equation 

x A (t) = A(t)x + B(t)u(t), x(t )=x , 
y(t) = C(t)x(t), 

on a time scale T such that /i m ; n < /z(£) < // max for all t G T. Suppose there exist constants s.\,e% > 
and a strictly increasing function C : T — > T such that < C(t) — t < M holds for some constant 
< M < oo and all t G T 



< 3b(i,C(i)) < e 2 I, for all t G T. 
Then given a > 0, the state feedback gain 

K(t) := -B^OtJ + ^A 3 -^)-^^^^), 



(3.3) 



(3.4) 



has the property that the resulting closed-loop state equation is uniformly exponentially stable with 
rate a. We call C(t) the controllability window for the problem. 

log(l + u(t)a) 

Proof. We first note that for N — sup ^ , we have < N < oo since T has bounded 

graininess. Thus, 

. *-t / w ( [ c(t) log(l + u(s)a) A \ 

,C(t) 

> exp I - / NAs 



> e 



-N(C(t)-t) 



-A1N 



Comparing the quadratic forms x T ^c a (t,C(t))x and x T Sfc(t, C(t))x gives 



-4MJV 



&c(t,C(t)) < & Ca (t,C(t)) < & c (t,C(t)), for all t G T. 



Thus, (3.3 1 implies 



£ie -4Miv 7 < <g Ca (t jC (t)) < £ 2 /,for all i G T, 
and so the existence of ( ^^ 1 {t,C{t)) is immediate. Now, we show that the linear state equation 



(3.5) 



z A {t) = [A(t)(l + n(t)a) + al\z(t), 



where 



A{t) = A{t)-B{t)B T {t){I + l i{t)A T {t))^%C{t)), 
is uniformly exponentially stable by applying Theorem |3.2| with the choice 



Lemma 3.2 then gives the desired result. To apply the theorem, we first note that Q(t) is symmetric 
and continuously diffcrcntiablc. Thus, (3.51 implies 



iMN 



for all t G T. 



1/ < Q(t) < e — 

£2 £i 

Hence, it only remains to show that there exists v > such that 

T" 



I + fi(t) (1 + /j,(t)a)A(t) +al 



(t) I + n(t) (l + n(t)a)A(t)+aI - Q(t) 



< -vl. 
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We begin with the first term, writing 

r i T l r r - 

I + fJ,{t) (1 + n{t)a)A(t) + al Q(<r{t)) I + fJ,(t) (1 + n(t)a)A(t) + al 

= (l + /i(i)a) 2 \[l + ii{t)A T {t)] -^(t,C(t))[I + ^Ait)}- 1 fi(t)B(t)B T (t) 

•^>(t),C(a(i))) [[I + ^(t)A(t)]-^t)B(t)B T (t) [l + ^t)A T (t)]~ l ^{t,C(t)) 
We pause to establish an important identity. Notice that 



[I + fi(t)A(t)]& Ca (t,C(t)) [l + n(t)A T (t)]=^(t)B(t)B T (t) 



Sfc„(^W,C(t)) 



(1 + M (i)a)4 ■ 
This leads to 

I- [I + »{t)A{t))- l n(t)B{t)B T {t) [l + ^t)A T {t)Y l ^ c %C{t)) 
= (1 + MWar 4 [/ + Kmt)}- 1 & Ca (a(t),C(t)) [I + fi(t)A T (t)] _1 3£(t, C(t)), 
which in turn yields 

I - <$c% C(t)) [I + Mt)A(i)]- 1 »{t)B{t)B T {t) [I + ^(t)A T (t)} 1 
= (1 + ^t)a)-^c%C{t)) [I + Kmt)}- 1 Sf c «X*),C(*)) [I + v(t)A T (t)] - 1 . 
The first term can now be rewritten as 

(1 + n{t)af [[/ + n(t)A T (t)] - Va%C{t)) [I + mAit)]- 1 ^t)B{t)B T (t) 

■^(a(t),C(a(t))) [[I + Kt)A(t)]-n(t)B(t)B T (t) [I + ^(t)A T '(t)]" 1 Sf£(t,C(t)) 
= (1 + »(t)a) 2 [i - C{t)) [I + K^Ait)}- 1 n(t)B(t)B T (t) [I + ^(t)A T (t)} 

■ [l + ii{t)A T {t)} ^(a(t),C(t)) [I + n(t)A(t)} 
■/-[/+ K^Ait)}- 1 »(t)B(t)B T (t) [I + ^(t)A T (t)} - 1 <$c% C(t)) 



(3.6) 



(3.7) 



(3.8) 



Using (3.7) and (3.8), we can now write 

I + fi(t) (1 + fi(t)a)A T (t) + aI Q(a(t)) I + n{t) (1 + fx(t)a)A(t) + al 

= (i + »{t)a)- 6 %%c{t))\i + mmr 1 ^c>(t),c(t))^>(*),cw*))) (3 - 9) 

• & Ca (a(i), C(i)) [I + Kt)A T (t)] - 1 Sf£(*, C(t)). 
On the other hand, from the definition of ^c a (t,C(t)), we have 

9cA<r{t),C{*m>&cMt),C(t)), 

which in turn implies 

^ c >(£),C(a(i)))<^ c >(i),C(i)). 



Combining this with (3.9 1 gives 

I + fj,(t) \(1 + fi(t)a)A T (t) + al] } Q(a(t)) \l + fj,(t) \(1 + fi(t)a)A(t) + al 



< 
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Applying (3.6 1 again yields 

I + fx(t) (1 + fi(t)a)A T (t) + al Q(cr(t)) I + fi(t) (1 + fj,(t)a)A(t) + al 
< {\ + ^{t)ar^%C{t)) 

• "(1 + M*M 4 ^b» (t, C(t)) - (1 + /i(i)a) 4 [I + li{t)A{t)]- x fi(t)B(t)B T (t) [i + ^t)A T (t)] ~ X 

•Sf c >,C(i)) 
<(l + ^(t)a)- 2 ^(t,C(t)). 
Thus, 

/ + n(t) \(1 + fi(t)a)A T (t) + al} 1 Q((j(t)) \l + fi(t) \(1 + n(t)a)A(t) + al} 1 - Q(t) 



, _ (i + M(*)a) 2 -i y i (f>c(f)) 



< 



^)(l + M (t)a) 2 ' 
(1 + Ai(i)«) 2 - 1 



I. 



This last quantity is not necessarily constant, but since the graininess of T has a (presumably 
nonzero) upper bound, 



(1 + fi(t)a) 2 - 1 2a + n(t)a 2 



> 



li(t)e 2 (l + n(t)a) 2 e 2 (l + fi(t)a) 2 e 2 (l + Aimaxa) 2 ' 
Setting ^ := a _1 e 2 (l + ^maxt*) 2 , w e obtain 

/ + [(1 + ) u(t)a)i T (i) + a/1 1 Q(cr(t)) [/ + (i(t) \(l + n(t)a)A{t) + al}} - Q(t) 



tit) 



< -vl. 



□ 



Several natural questions arise regarding Theorem 3.3 



(Ql) Is the assumption (3.3 1 for C(t) reasonable? 

(Q2) Does C(t) have a single, unified form regardless of the time scale? 

(Q3) How does any such unified C(t) compare to its analogue on R and Z? 

(Q4) How does the state feedback gain in (3.4 1 compare to its analogue on E and Z? 



First, the assumed bound (3.3) is not severe since it is a reformulation of the controllability 



Gramian invertibility criterion in Theorem 3.1 and controllability of the open- loop system is a 
prerequisite for feedback stabilization. The requirement that C(t) be increasing on an interval just 
ensures a nondegenerate interval (in the time scale) on which the open-loop system is controllable. 
In response to (Q2), for any 5i,S 2 > 0, we propose the controllability window 



C{t) ■- 



t + Si, if a(t) = t, 

a k (t), if a l (t) ^ t for all < i < k, 

cj k (t) + S 2 , else, 



where a k means the composition of the forward jump operator a with itself k — 1 times. 

Note that, for T = K, C(t) = t + 5 for any S > is sufficient, while on T = Z, the function 
C(t) = t + k for k G N meets the criteria. These coincide with the controllability windows found in 
the literature for both the continuous and discrete cases [21 [10l [36] , giving a very satisfying answer 
to (Q3). 



Finally, we remark that the general form of the state feedback gain in (3.4) coalesces nicely with 
the known forms of K(t). When T = R, takes the form 

K(t) = -B T (t)^(t,t + S), 
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where C(t) = t + 5, 5 > 0, and it is shown in [12, 36 that the system is stabilized. On the other 
hand, when T = Z, (3.4 1 becomes 

K(t) = -B T (t)A- T ^(t,t+k), (3.10) 

where C(t) = t + k, k G N. Note that ( |3.10 1 is a shifted version (again, due to the difference equation 
formulation rather than recursive formulation of the problem) of the familiar discrete state feedback 
gain [36]. 

4. Experimental Results 

Throughout the preceding discussion, it has been assumed that the time scale is known a priori; 
in other words, that a system's time domain is known before the system dynamics "start" at time 
time t = 0. Under this assumption, it is possible to calculate feedback gain K (t) a priori if the 
system's state matrices A(t) and B(t) are known. Scenarios in which non-standard time scales (not 
R or hZ) are useful may come about for different reasons. For example, it may be that a computer 
controller cannot guarantee consistent hard deadlines (i.e. "real time" response) for communication 
with sensors and actuators; in this case, a time scale may be scheduled that is more amenable to the 
other tasks the computer is performing. A similar problem may occur in a networked, or distributed, 
control system, in which various network traffic activities determine the time scale. In either case, 
if the time scale is known, or at least known over some finite window into the future, the feedback 
gain may be computed and applied in advance. 

To illustrate the paper's central theorem in hardware, a simple experiment was devised using a 
DC motor with an intertial mass. A system identification procedure produced approximate 2 Tlc '-order 
state matrices 

" 1 

-0.15 



A 



B 




13.8 



dx{t) 
dt 



= Ax(t) + Bu(t), te 



where state vector x(t) is the motor's angular shaft position (rev) and velocity (rev/s), and u(t) is 
the input voltage (V). Electrical dynamics were neglected due to the relatively small electrical time 
constant. The hat notation designates A and B as the state matrices of a dynamical system on K. 
Sample- and- hold discretization to an arbitrary time scale T gives 

B{t) = 



A(t) = 



y (Mt)Y 

,i=i 



B. 



t e T. 



Now equation (3.1a) is in force. 

To begin, several discrete time scales T were selected and populated with anywhere from I — 
20 to 100 points (all of the time scales in these experiments were purely discrete with no continuous 
intervals). Choosing a window operator C(t) = o~ k (t) simply amounted to choosing a window sized 
k > 0. Some ramifications of this choice are discussed later. Next, using MATLAB, K{t) was 
computed over the first I — k points in the time scale. K{t) and T, along with control law u{t) = 
K(t)x(t) + N(t)r(t) where N(i) = 1 and r(t) = 2h(t) where h denotes a unit step function and 
x(0) ^ were programmed into a computer running the QNX operating system and outfitted with 
digital and analog input/output hardware. Internal high-precision timers were employed so that 
the system would acquire the motor states x(t), and apply drive current u(t), only at the pre- 
determined points in t € T. The resulting state trajectories therefore illustrate the closed-loop 
system step response. 

Three examples of the closed- loop step response are shown in Figure [2] Time scale T a of example 
(a) was created with widely varying grainincss. Graininess fJ- a (t) occurs in multiples of 10ms, with 
the first four points exhibiting graininess of 80 or 90ms, and points thereafter exhibiting graininess 
of 10 or 20ms. This time scale was designed to emulate the timing of a real-time process that is 
unable to meet hard 10ms deadlines. If a deadline is missed, i.e. the controller cannot respond at 
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(a) 

1 - " . 



0.2 



0.4 



0.6 



0.8 




Figure 2. Step responses for the three cases discussed in the text. Note that the 
time axis in case (a) has been magnified in order to see the individual points in the 
time scale. 



the next specified t G T a , the next point in the time scale is scheduled some multiple of 10ms in 
the future. Time scale Tb of example (b) exhibits graininess from a uniformly random distribution 
between 80 and 150ms. The third example (c) combines two interesting phenomena: a time scale T c 
of uniformly random distribution, with a very large gap in the middle. Example (c) is particularly 
interesting because it can be seen that the controller has computed its best estimate (as close as the 
model allows) of the open-loop constant input current required to move the motor shaft to near-zero 
error by the end of the gap. 

In each example, it was necessary to choose a window size k as well as a constant a for the 
computation of K(t). The performance impact of different choices is not obvious, and is explored 
through simulation in Figures [3] and [I) These fi gures show how step response settling times (the 
time required for the response to fall within 10% of its final value) are dependent on k and a, for 
k e {2, ...,25} and a G [0.01,0.79]. Figure [3] shows that the settling time of example (a) is relatively 
insensitive to changes in a, but highly sensitive to changes in window size k. Small windows would 
seem to produce better performance; however they also induce large magnitudes in the values of K, 
which in turn produce large magnitudes in u that may exceed the physical limitations of the system. 
Figure [4] shows the same analysis for example (b) ; one difference is that now the settling time is 
somewhat more sensitive to the choice of a. 

These examples illustrate that the full-state, closed-loop feedback u(t) = K(t)x(t) will indeed 
stabilize a simple 2nd-order system on a variety of interesting time scales. However, there are still 
several practical limitations to overcome. First, the actual computation of K(t) is very complex, 
and it is doubtful that small embedded control processors could compute K (t) in real time. Second, 
K(t) depends on knowledge of the time scale over some finite future window (defined by the operator 
C(t)). Thus, K is not strictly causal (although it does not depend on knowledge of the system states 
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Figure 4. An image plotting parameter a versus window size k versus settling 
time for experiment (b). 



in the future). Lastly, K depends on knowledge of the system parameters, which are often not well 
known. It should be noted, however, that the first and third of these limitations also apply in the 
"classical" cases (feedback control on M and Z). The second limitation is obviated on R and Z 
because the time scale is always known a 'priori. 
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